


I 



DOCUMENT RESUME 



ED 041 274 




AUTHOR 


Sinaiko, H. Wallace; Brislin 


TITLE 


Experiments in Language Tran 
Fnglish- to- Vietnamese. 


INSTITUTION 


Institute for Defense Analys 


SPONS AGENCY 


Department of Defense, Washi 
Research Projects Agency. 


REPORT NO 


P-634 


PUB DATE 


Jul 70 


NOTE 


80p. 


EDRS PRICE 


EDRS Price HP- $0.50 HC-$4.10 


DESCRIPTORS 


^English, ^Evaluation Method 
Program Costs, ^Technical Wr 
^Vietnamese, Writing Skills 



AL 002 476 



Richard W. 

.ation: Technical 



D.C. 



>n f Va. 
Advanced 



ABSTRACT 

This paper documents the results of a series of 
experiments conducted by the Institute for Defense Analyses on 
translating technical material from English to Vietnamese. The work 
was accomplished in support of the Office cf the Deputy Director, 
Research and Engineering, Deputy Director for Southeast Asia Matters. 
The paper addresses the question of translation speed, number of 
errors, and quality assessment. Three different methods for measuring 
the quality of translations are examined: back-translation, knowledge 
testing, and performance. Translation costs and means of writing 
translatable English are also reviewed. It is concluded that: 400 
words per hour is a reasonable speech expectation for technical 
material; quality of translation significantly affects performance, 
and quality may be sampled by any of the means 
reduced by several methods but seventy dollars 
a reasonable estimate. (Author/FWB) 
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I. SUMMARY AND CONCLUSIONS 



PURPOSE 

Translation of technical English is a critical aspect of the larger effort of 
transferring American military equipment to the armed forces of the Republic of 
Vietnam, because each item is accompanied by considerable documentation. Many 
issues are involved: Is it possible to translate with high quality from a highly tech- 
nical language into one that is very limited in its technical terminology? What are 
the available resources for translation of English to Vietnamese? How fast can 
professional translators process technical material? What types of errors, if any, 
are made by translators and how frequently do they occur? How can finished trans- 
lations be evaluated for fidelity (i.e, , accuracy) ? This study, undertaken at the re- 
quest of ODDR&E, covered a series of investigations of several of these questions: 
the possibility of high quality translation, and assessment of speed, errors, and 
methods for quality measurement of translated technical English to Vietnamese. 

Several experiments were conducted to provide: (1) information about different 
methodologies that could be used to assess the quality of translated technical English; 
and (2) data on factors that affect the quality of text translated from English to Viet- 
namese. Results of the experiments should be of value to both l ing uists and other 
behavioral scientists, and to Department of Defense agencies facing problems of 
turning over technical equipment to the RVNAF. The study demonstrates methods 
of measuring translation quality, and provides quantitative evidence about the sig- 
nificance of good technical translations. Further, there are guidelines for writing 
translatable English. 



METHOD 



Three techniques were used: (1) the analysis of back -translated Vietnamese, 
the technique in which one bilingual translates from English to Vietnamese and an- 
other bilingual translates back from Vietnamese to English; (2) the measurement of 
translation quality through knowledge testing of Vietnamese readers in their own 
language; and (3) the assessment of technical material -both translated Vietnamese 
and the original Engli &n text— through performance testing of technicians who must 
use the material to repair or adjust part of an aircraft. 

English -to -Vietnamese translations, as well as back -translation from Viet- 
namese into English, were done by twelve highly skilled professional translators. 

All the material they translated was technical English, sampled from representative 
USAF tech orders, U. S. Army tech manuals, or Air Force job performance aids 
(e.g. , PIMO).* Subjects who served as users of translated material were Vietnamese 
Air Force airmen being trained as helicopter technicians by the U.S. Army Trans- 
portation School , Ft. Eustis, Virginia. Finally, U.S. Army enlisted technicians, 
comparable in training and experience to the VNAF airmen, served as an experi- 
mental control group. Both American and Vietnamese subjects were probably typical 
of users of this type of material. 

Analysis and review of translated Vietnamese were done by a linguist -consultant 
and, in some cases, by VNAF liaison officers. Back -translated material was 
analyzed by the experimenters. 

RESULTS 

Feasibility of Translation 

Vietnamese is a language with virtually no technical terms. For this reason 
translators are forced to resort to one of several techniques in dealing with tech- 
nical English: 
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• they may use French or Chinese or English, transliterated and presented 
in Vietnamese characters; 

• they may coin new terms; 

• they may use several available Vietnamese words to "explain around" the 
English term. 

However, usable translations were produced by the 12 bilinguals hired for these 
experiments. 

Translation Speed 

Technical English can be translated into Vietnamese at about 400 words per 
hour (2400 to 3000 words per day), although unfamiliar material is handled at a 
somewhat lower rate. 

Back translation into English, which may be necessary as a quality control 
technique, can be done about 10 percent faster, i.e. , 450 words per hour. 

There is no speed advantage for translators working with specially formatted 
proceduralized job performance aids such as PIMO, i.e. , their output is the same 
as when translating conventional technical manuals. 

Translators claim to be able to handle standard, nontechnical English to Viet- 
namese at rates of up to 1000 words per hour (a figure not verified in this study). 
The main reason for the much slower pace found here is an inherent characteristic 
of the Vietnamese language: technical terms are almost nonexistent and translators 
are forced to coin words or, more often, "explain around" many English words. 

For example, the frequently used aeronautical term "tachometer" may become 
"rotation measuring machine" in Vietnamese. Not only does the absence of a tech- 
nical terminology affect the speed of translation, but it also results in widespread 
nonstandard usage, both by translators and readers. 

Quality of Technical Translation 

Given highly competent translators, careful review by equally skilled linguists, 
lexical aids such as technical glossaries, and a form of compensation that stresses 
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accuracy over speed, it is possible to produce accurate technical Vietnamese from 
standard U. S. military maintenance documents. This has been demonstrated by 
several approaches to assessing translation quality: back -translation, knowledge 
testing, and performance testing. 

As a general finding, for every 100 words of technical English translated into 
Vietnamese, about five words or combinations of words are in error. While this 
may appear to be a low rate , in view of the operational importance of maintenance 
material the error rate should probably be close to zero. 

Translator accuracy for job performance aids (e.g. , PIMO material) is about 
the same as for conventional technical material. 

Several types of changes/errors occur in translated Vietnamese: (1) words 
or phrases in the original corpus are omitted; (2) synonyms are substituted for di- 
rectly equivalent terms; (3) functional descriptions are introduced when the technical 
English has no equivalent Vietnamese; (4) words or phrases are garbled; and (5) 
words are used which definitely change the meaning of the original (indicating, per- 
haps, a lack of understanding by the translator). 

Irrespective of their bilingual abilities, good translators demand special 
glossaries and technical word lists, and their performance directly reflects the use 
of such aids. 

There is little or no relationship between quality of translation and the speed 
of the translators in these experiments. This is true for English to Vietnamese, 
Vietnamese to English and a combined rate for the two directions. 

Methods of Assessing Translation Quality 

Each of the techniques employed in this study is sensitive to differences in 
translation quality and each has unique advantages. 

Back-translation into English permits nonbilinguals to compare original texts 
with retranslations. The technique is relatively rapid. However, it is possible for 
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the back -translator to introduce new errors to the first translation, or to cancel 
errors, and there is no satisfactory way to prevent these things from happening. 

Knowledge testing, in which subjects read a translation and answer questions 
about it, is highly sensitive to differences in translation quality. Average scores 
varied by more than a factor of two, i.e. , 6. 1 versus 2.6 on a ten -item test, for the 
best and worst translations. When the same man translated both PIMO and. cor- 
responding tech order material, knowledge test scores did not differ. Scores on 
knowledge tests correlated positively with independent ratings by experts on quality 
of translations and with an error analysis of back -translations. The technique is 
somewhat time-consuming to administer and it requires that test questions be written 
and translated; also subjects' answers must be scored in the target language. 

Performance testing is a way of measuring the quality of technical translations 
by having readers perform a task using the translations. To the extent that such 
performance is good or bad, the translation is assumed to be good or bad as well. 

Our experiments showed that different quality levels of a translated technical manual 
were directly reflected in the work of crews of helicopter technicians. The best 
translation into Vietnamese resulted in performance on a very difficult, multi-step 
task at a level that was approximately equal to that of U. S. Army technicians who 
used the English manual. Error -free performance was observed for 73% of the tasks 
done by each group, U. S. Army and VNAF. Lesser -quality translations brought the 
corresponding figure as low as 11%. VNAF technicians using English, the language 
in which they had been trained, worked at a 41% error-free level. Performance 
testing is the most time-consuming of the quality assessment methods we used. It 
also requires the availability of equipment (UH-1H helicopters in our case) and the 
close cooperation of expert technical observers to evaluate subjects' performance. 

Subjective opinion, as a method of evaluating quality of technical translation, 
is both inaccurate and misleading. Specifically, we have two reasons for making 
such an assertion: (1) some Vietnamese airmen, working with the best available 
translation, expressed dissatisfaction with having to read unfamiliar terms; in fact, 
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however, the performance of these technicians was much better than that of other 
VNAF technicians who used the English manual; and (2) technically competent bi- 
lingual reviewers called the poorest quality translation . .not bad. . . " when actual 
performance with that translation was the worst measured. 

Cost of Technical Translation 

Good Vietnamese translators are difficult to locate and their services are ex- 
pensive. Wc paid each of the main group of translators $8.00 an hour. At this rate, 
plus a higher hourly fee for the consultant -reviewer, the best quality translation 
cost $140 for approximately 1000 words of English. To obtain lesser quality ma- 
terial we used the services of a commercial translation company and those of a 
single free-lance linguists at $39 and $30 per 1000 words, respectively. Neither 
of these translations had the benefit of a review. (The performance test results 
showed marked differences between the three quality levels.) We believe that the 
high cost of the best translation procedure could be brought down, perhaps by a 
factor of two, in a production operation. However, $70 per thousand words may be 
an excessive price to pay. 

Translation of Proceduralized Job Aids and Conventional Technical Material 

Proceduralized job performance aids (JPA) are improved ways of providing 
maintenance information to technicians. JPAs are written in a special format: they 
use standardized verb lists, sentences are short, and sentence structure is simpli- 
fied (Sinaiko, et al. , 1969) . It was not the main purpose of this study to look into 
JPAs but, because at least one item of equipment (i.e. , the UH-1H helicopter) is 
to have JPAs, we included some representative proceduralized material among the 
samples of technical English to be translated. This summary is based on transla- 
tion speed trials, on back -translation analyses, and on knowledge test results. 

There is no speed advantage for translators of JPAs versus conventional 
technical English. 

Translator error rates are about the same for JPAs and technical English. 
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Types of errors are distributed almost identically between JPAs and conven- 
tional material. 

Writing Translatable English 



Based on an error analysis of the back-translations, we derived eight rules 
for writing English that will lead to more accurate translations into Vietnamese. 
The most important of these rules suggest avoidance of: 

• long sentences, i.e. , over 16 words 

• complex noun phrases, e.g. , "organizational maintenance activities" 

• adverbs and prepositions indicating "where" or "when", e.g., 
"reasonably probable", "beyond". 

• abbreviations, e.g. , "Landing Gear Cont." 



RECOMMENDATIONS 

Following are what we believe to be the major, or priority, recommendations 
derived from this study: 

1. Develop bilingual glossaries of technical terms and other translator aids. 

'2. Provide and require quality control in all technical translation, e.g. , 
analysis of back-translation, knowledge testing and, if feasible, per- 
formance testing. 

3. Compensate translators so as to put greater emphasis on accuracy than 
speed. 

4. Do not rely on expert opinion to evaluate technical translations. 

5. Prepare new technical documents using English that is likely to be trans- 
lated accurately. 
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II. INTRODUCTION 



"...The most critical need... a year ago and 
today, is for material in the Vietnamese language... 

This is viewed as the most difficult job yet to be 
accomplished. . . Tf (Henderson et al. , 1970) 

Technical documents --maintenance manuals, technical orders, and 
instructional material--are as critical in the use of complex military 
equipment as the hardware itself. Training men how to use and service 
equipment is inevitably tied to the quality of the technical documents 
they are given. And in the case of material intended for foreign na- 
tionals --specifically, the Armed Forces of the Fepublic of Vietnam-- 
there is an added class of problems: most of the intended users do 

not read English and documents must be translated. (An alternative 
solution, not treated in this study, is to train Vietnamese military 
personnel to read English, thus eliminating the need for translation.) 

Language translation methods are as old as the printed word. But, 
surprisingly, there is almost no literature on the technology of trans- 
lation, and on the accuracy that can be expected from it. One is 
forced to rely on the subjective views of translators or bilingual 
readers about the quality of a translated document. 

Vietnamese is simple in structure. However, one characteristic 
of the language makes translations from technical English very diffi- 
cult. That is, Vietnamese contains almost no technical terms. A re- 
lated fact is that Vietnamese is not a precise language by Western 
standards. We have heard anecdotal evidence that Vietnamese frequently 
misunderstand each other when attempting to exchange exact information. 

Because of its importance to the current program of turning over 
American military assets to the Vietnamese Armed Forces, the Deputy 



Director for Southeast Asia Matters, ODDR&E, requested the Institute 
for Defense Analyses to initiate a study of technical translation. 
Since January 1970, IDA has conducted a series of exploratory experi- 
ments on translating technical material from English to Vietnamese. 

As part of the Department of Defense accelerated modernization program 
for the Vietnamese Armed Forces, the IDA effort was undertaken to ob- 
tain quantitative evidence about many translation problems. Is high 
quality translation from technical English to Vietnamese possible? 

How rapidly can language translators process technical English? How 
many errors do they make? What is the nature of translation error for 
this type of material? How does translation quality affect the work 
Of Vietnamese technicians? Do some forms or styles of technical 
English permit better translations than others? 

In addition to addressing these questions, we were equally con- 
cerned about more fundamental, and general, problems of assessing the 
quality of translations. Since relatively little work has been done 
on assessment, the IDA experiments were intended to provide informa- 
tion about different approaches to measuring the goodness of transla- 
tions. What we have learned should also be of value to linguists and 
others who are concerned with quality control in language translation. 
In all cases, the methods of evaluating translations that we have used 
can be applied by people who themselves do not speak another language 
besides English. 

It is important to indicate what this study does not treat. We 
did not deal with any aspects of automatic translation, i.e., full 
machine (computer) translation or machine-aided translation. (Pierce 
et al , 1966, do cover these issues.) Neither did we try to measure 
the relative merits of training Vietnamese in English or in their na- 
tive language. Finally, although we used many Vietnamese airmen as 
test subjects in the experiments, our results should in no way be 
construed as an evaluation of the abilities of those men. 

The work reported here is an extension of an earlier study, also 
for ODDR&E, on training Vietnamese to operate and maintain complex 
military equipment (Sinaiko et al, 1969). 
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III. METHODOLOGY 



This chapte.r describes the approach used in the study of trans- 
lations between technical English and Vietnamese. The linguist- 
consultant and 12 translators are described, as are the technical 
materials on which the translators worked. Also covered are the three 
methods that were used to study the speed and/or quality of transla- 
tion: back -translation, knowledge testing, and performance testing. 

BILINGUAL CONSULTANT 

A highly skilled consultant was hired who assisted in several 
phases of this investigation. He possessed the following qualifica- 
tions: Vietnamese native, university teacher in Vietnam, 20 years in 

the U.S., Ph.D. in educational psychology with additional training in 
linguistics, experience with translating technical materials, has 
taught Vietnamese how to translate. This consultant recruited 12 
translators considered by him to be the best available and he evalu- 
ated much of their work. 

TRANSLATORS 

The 12 bilinguals worked for a minimum of eight hours, translating 
and back-translating, as well as telling us what problems they en- 
countered and what aids might make their translations faster and better. 
Biographical information on the 12 bilinguals was gathered from them 
so that their qualifications can be described. 

At the time of these experiments, seven of the 12 bilinguals 
worked for the Voice of America as professional translators. One 
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worked for IBM, one for the State Department, one was a Ph.D. and an- 
other a Ph.D. candidate, and one was a language teacher. All were born 
in Vietnam, Vietnamese being their first language, and had spent an 
average of 28 years there. All had taken formal courses in the Viet- 
namese language through the secondary school level in Vietnam. On 
the average, the 12 bilinguals had spent 10 years in the United States. 
Ten of the bilinguals had attended accredited American universities 
for an average of 4.9 years with the language of instruction, of 
course, being English. 

All 12 had worked either part-time or full time as translators 
for an average of 11 years. Surprising to us, all 12 had translated 
some technical materials in the past. None, however, had ever trans- 
lated technical materials as a full time job. The materials that they 
had translated included a book for a basic electronics course and 
manuals for (1) weapons, (2) diesel and automobile engines, (3) a mine 
sweeper, and (4) farming equipment. In addition, some had translated 
glossaries of military flying terms and psychological terms. 

MATERIALS TO BE TRANSLATED 

Since one purpose of this research was to investigate whether or 
not adequate translation between technical English and Vietnamese is 
possible, we chose three types of technical materials with which the 
bilinguals would work. All three were the types of materials that 
must be translated from English to Vietnamese as part of Vietnamiza- 
tion. The three types, and a description and sample of each, are: 

1. The technical manual for the UH-1H helicopter (TM 55-1520- 
210-20). This document was chosen since the translation of 
it is critical to a priority item. The document is in the 
conventional tech manual form, with each system of the air- 
craft covered by a chapter. Tech manuals form the basis of 
training programs and are used as textc. They are also used 
as working guides by technicians. Criticisms of tech manuals 
(summarized by Sinaiko et al., 1969) include: 
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'(a) manuals are organized more for building hardware than 
maintaining it, and 

(b) many manuals are difficult to read and use, and do not 
emphasize troubleshooting for the repairman. 

In this research, Chapter 7 on the ’’Power Train System” of 
the UH-1H helicopter was translated by the 12 bilinguals. 

A sample from the Chapter follows. Another sample is con- 
tained in Appendix A. 

7-1. PURPOSE. 

7-2. This chapter provides all the instructions and 
information necessary for maintenance authorized to 
be performed by organizational maintenance activities 
on the power train system. The power train is a sys- 
tem of shafts and gear boxes through which the engine 
drives main rotor, tail rotor, and accessories such as 
DC generator and hydraulic pump. The system con- 
sists of a main drive shaft, a main transmission which 
includes input and output drives and the main rotor 
mast, and a series of drive shafts with two gear boxes 
through which the tail rotor is driven. (See figure 
7-1.) 

2. The job performance aids (JPA) for the C-141A aircraft. More 
specifically we used PIMP (Presentation of Information for 
Maintenance and Operation), a relatively new method for pre- 
senting technical maintenance information. Like other JPAs, 
PIMO is formatted differently in the hope of being more 
understandable. This new format was designed so that tech- 
nicians could read and use the PIMO materials more easily 
than the conventional USAF tech order (T.O.). The new format 
includes (Goff et al . , 1969; Sinaiko et: al. , 1969): 

(a) organization of maintenance tasks based on experimental 
analysis of the mechanic’s job and of the aircraft 

(b) a fixed syntax, including a common sentence structure 
and recommended maximum sentence length 

(c) a standardized verb list 
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(d) limited amounts of information in each maintenance step, 
corresponding to empirical studies of the mechanics’ 
memory span. 

PIMO has fewer different verbs, uses shorter sentences (than 
the T.O.), and there are many sketches corresponding to in- 
structions. There is great interest in the Air Force for the 
PIMO type of presentation, and we wanted to see if it offers 
any advantages for translation over conventionally prepared 
technical orders. In this research, a section of Volume 18 
entitled, "Operational Checkout of Normal, Emergency, and 
Parking Brake Systems" was translated by the 12 bilinguals. 
Examples from both the page giving the description of the 
material and personnel required, and a set of instructions 
for a single task, are presented here. 

The excerpts from Volume 18 illustrate the PIMO format: 



OPERATIONAL CHECKOUT OF NORMAL, EMERGENCY 
AND PARKING BRAKE SYSTEMS 

INPUT CONDITIONS 

Applicable Stria i Nos. 

All 

Special Tools and Test Equipment 

Brake Pressure Tatter, 3S5OO10 
Push-pull scale 

Supplies 

Four maintenance In progress tag*. No. 1492. 

Eight circuit breaker labels to Indicate maintenance In progress. 
Three labels to Indicate maintenance In progress. 

Personnel Required: Two 

Man A performs activity in flight station. 

Man B starts at left main landing gear. 

Specialist will be required to operate hydraulic cart when requested. 



FIGURE 1 . PIMO Material for 0141 -A, Page 5-1, Volume 18 
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'The following figure, also from Volume 18, shows a set of in- 
structions for a maintenance task. The sketches on the right 
correspond to the instructions on the left. 



OPERATIONAL CHECKOUT OF NORMAL AND 
EMERGENCY BRAKE SYSTEMS - MAN A 



NOTE 

Do not continue until man B requests 
that hydraulic system be pressurized. 



1. Push pilot's and copilot's rudder 
pedals until rig pin can be installed. 
Install rig pin. 



2. Request that specialist apply pres- 
sure to No. 2 hydraulic system. 



3. Turn three hydraulic system No. 2 
switches to ON. 

Check that pressure indicator reads 
3000 (± 250) psi. 



4. Set brake selector switch to NORM. 

Check that normal brake pressure 
indicator reads 3000 { ± 250) psi. 

Report to man B. 



NOTE 

If one tester is being used by man B t 
for check of normal and emergency 
brakes, go to next frame. If two are 
used, go to Frame 24. 




SWITCHES 



FIGURE 2. PIMO Material, Page 5-6, Volume 18 



3. The USAF T s Technical Order for the C-141A (T.0. 1C-141A-2-12) . 
This document was chosen in order to compare translations of 
the same material written in the PIMO form, described above, 
and in the T.0. form, also described above. The qualities of 
the T.0. for the C-141A are similar to those of the UH-1H 
T.M., already described. In this research, the 12 bilinguals 
translated all or part of Chapter 8 of the C-141A T.0. en- 
titled, "Main Landing Gear Brake and Anti-Skid System." This 
chapter covered the same material on the brake system, but in 
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a different format, as the PIMO aides. A sample from the 
C-X41A T.O. follows: 



8-22A. PREPARATION FOR NORMAL AND EMER- 
GENCY BRAKE SYSTEM OPERATIONAL CHECKOUT. 
(See figure 8-4 A.) The following steps are required 
to prepare for normal and emergency brake system 
operational checkout Refer to paragraph 8-23 for nor- 
mal and emergency brake system operational check- 
out. 



a. Obtain two brake pressure and bleed testers 
3S50018 and appropriate containers for collecting 
bleed fluid. 

b. Remove dust caps from ends of tester hose. 

c. Remove AN6204-1 bleed valves from brake bleed 
ports. 

d. Connect the eight long tester hoses (4 hoses each 
tester) numbered 1, 2. 3 and 4 to brake assembly 
bleed ports (4 hoses each side). 

e. Place short tester hose into container. 

f. Insure all valves are closed on brake pressure 
and bleed tester. 



FIGURE 3. Page from USAF Tech Order, T.O. 1C-141 A-2-12 



TRANSLATION TASKS 

The 12 translators worked on different tasks, and their total 
time for each translation task was recorded. Some of the tasks in- 
volved translation between English and Vietnamese, and some involved 
back-translation between Vietnamese and English. The tasks on which 
translators worked will be described here since these tasks provided 
the raw materials used in subsequent tests of translation quality. 

Each of the 12 Vietnamese-English bilinguals translated or back- 
translated for eight hours. During this time, there were eight dif- 
ferent translation or back-translation tasks to be performed. Of the 
eight tasks, all 12 bilinguals translated in at least three tasks, 
and all 12 back-translated in at least one task. For the other four 
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tasks, six of the bilinguals translated two more times and the other 
six bilinguals back-translated two more times. Table 1 explains the 
eight tasks and the number of bilinguals performing each task. 

TABLE 1. EIGHT TRANSLATION TASKS AND NUMBER OF BILINGUALS 

PERFORMING EACH TASK 



Task 1 

6 bilinguals translate 200 words from UH-1H T.O. 

6 bilinguals translate 200 different words from UH-1H T.O. 

Task 2 

Each of the 12 bilinguals back-translates material he did not 
translate for Task 1 

Task 3 

12 bilinguals form 6 teams of 2 and team-translate additional 
UH-1H material for 90 minutes 

Task 4 

6 bilinguals translate material from C-141A T.O. for 90 minutes 
Task 5 

6 bilinguals back-translate materials from Task 4 
Task 6 

6 bilinguals translate material from PIMO aids for the C-141A 
for 90 minutes 

Task 7 

6 bilinguals back-translate materials from Task 6 
Task 8 

5 bilinguals* who back -translated in Tasks 5 and 7 translate 
materials from either T.O. or PIMO aids for C-141A 

NOTE: UH-1H T.O. refers to TM 55-1520-210-20, chapter 7 

C-141A T.O. refers to T.O. 1C-141A-2-12, sections 8-22A and 8-23 
PIMO aids for C-141A refers to Volume 18, section 5 



V; 

Six bilinguals were given Task 8 , but only 5 were able to complete 
it. 
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All 12 bilinguals worked in quiet rooms and had access to an 
English dictionary (Webster’s Seventh Collegiate Edition). Tasks 1, 

2, and 3 (in that order) were performed during a four hour session on 
one day, and Tasks 4 through 8 were done on a second day. On the 
second day, three translators performed Task 4 (C-141A T.O.) and then 
did Task 6 (C-141A PIMO materials), while the order was reversed for 
the other three translators. This was done so that a PIMO and T.O. 
comparison would not be confounded with practice, that is, all six 
working on one form of English and then the other. The order was also 
balanced for the six back-translators doing Tasks 5 and 7. Task 8 
always followed Tasks 5 and 7 for these six bilinguals. The instruc- 
tions to the subjects were as follows: 

INSTRUCTIONS TO TRANSLATORS 



We would like you to translate the document that you 
have in your hands into Vietnamese. We are more interested 
in a good quality translation than in speed, so please take 
your time so that you can do the best job possible. Some- 
times you may find an English word or phrase that does not 
have an equivalent word in Vietnamese. In such a case, you 
can do one of two things. 

1. ’’Coin” a Vietnamese word or phrase and circle it 
with a red pencil. (Make sure that the term 
’’coin” is understood.) 

Dung dich nay co< cjjc tirih lAm rD kirn khi*T 

Circle in red 

2. Or, if you feel that you don’t want to coin a 
word, just write the English word or phrase in the 
proper place, and circle it in blue ink, as in the 
following example: 

Dung dich nay co ( highly corro sive^kim khi< 

Circle in blue 

Please keep track of the words that you coin. On the 
yellow sheet that you see, write the English word or phrase 
in the first column, and then write your coined translation 
in the other column. The following example will help. 
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English Word or Phrase 



Your Coined Translation 

pit tong 
cah ngat gi<^ 



piston 

handle throttle 



Please try to coin a word wherever possible, but remember 
that we understand that you will not always be able to coin a 
word. 

Feel free to take short breaks whenever you are tired, 
and tc ask questions of one of us, who will be near you, 
either in this room, or by a quick phone call to 664 or 667. 

(Show phone in room.) 

Remember that we are interested in as good a translation 
as you can do. 

Translation rate for each of the eight tasks was measured by 
stop-watch . 

MEASURING TRANSLATION QUALITY 
Back -Translation 

One method for evaluating translation quality is back-translation 
specifically, comparing the original English and the back-translated 
English. In the back-translation technique, the investigator asks one 
bilingual to translate from the original to the target language, and 
then he asks another bilingual to translate back from the target to 
the original. The advantage of the technique is that, as opposed to 
other methods that have been suggested (e.g., Miller and Beebe-Center, 
1956; Carroll, 1966), the translation evaluator does not have to 
understand or speak the target language. A weakness is the fact that 
any mistakes in the back-translation may be due either to the trans- 
lator or to the back-translator. Thus, even though we evaluate back- 
translation to obtain insights about translation, a perfect transla- 
tion can be misinterpreted by an incompetent back-translator, or a 
good back-translator can "correct" a poor translation. This is why 
back-translation should always be complemented by other techniques, 
such as knowledge testing, to be described below. 



Knowledge Testing 



"Knowledge Testing" refers to a method of evaluating. translation 
quality in which subjects read a translated passage and then answer a 
set of questions about the content of the passage. If subjects can 
answer all the questions, the translation is assumed to be a good one. 
While the knowledge testing technique resembles the standard reading 
comprehension method, it differs in one important respect. Measures 
of reading comprehension contain items of graded difficulty, and are 
sensitive to individual differences., Knowledge testing is designed to 
elicit perfect scores if the translation is good, and should be in- 
dependent of individual differences. Suggested by Miller and Beebe- 
Center (1956) and by Macnamara (1967), the technique was first used by 
Brislin (1969), The knowledge test method was used in our studies of 
translation to Vietnamese since it provides another approach to the 
assessment of translation quality in addition to comparisons of original 
and back-translation, described earlier. This approach asks, "How well 
can people read and understand Vietnamese that has been translated from 
English?" The knowledge testing technique requires the researcher to 
write a series of questions in English about a passage and have them 
translated. He must also secure subjects who will read the passage 
and answer the set of questions. Tests must be scored by readers of 
Vietnamese, too. 

Performance Testing 

This technique has subjects perform a task requiring them to use 
either English or translated instructions. To the extent that sub- 
jects can complete the task, the translation is regarded as equivalent 
to the original English text. As in the evaluation techniques pre- 
viously described, the experimenter does not have to know the target 
language since he only has to assess the product of the translated 
performance instructions. Brislin (1969) had subjects complete a pic- 
ture using colored pieces of paper, scissors and paste, following 
eight separate steps . The task was to produce a picture after reading 
instructions in English or one of three Austronesian languages. Since 
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virtually all subjects were able to do the task without error, the 
translations were termed "equivalent". As far as we know, this was 
the first use of performance tests to evaluate translated English. 

Performance tests can be scored objectively. In the present ex- 
periment a very demanding 12-step adjustment task on a portion of a 
helicopter engine made up the performance test. Three -man crews worked 
together and the nature of the task required them to follow written 
instructions with care. Each of the 12 steps was assessed by a tech- 
nically qualified observer as "error free," "minor error" or "major 
error.” (Appendix A contains the complete task as extracted from the 
larger helicopter technical manual.) 

Performance testing is the most stringent translation evaluation 
technique since it demonstrates the quality of a translation by ob- 
servable behavior of subjects. However, the technique is the most ex- 
pensive and time consuming of the three we have used because the ex- 
perimenter has to: (a) define a suitable task, (b) have it trans- 

lated, (c) provide materials, e.g., a helicopter, (d) secure suitably 
trained subjects, e.g., Vietnamese and U„S. Army technicians, (e) have 
the subjects perform the task, and (f) obtain the services of ob- 
servers who are technically competent to grade the task. 

Recapitulation: Three Methods Compared 

The experiments reported in this study are based on three ap- 
proaches to assess the quality of translation: (1) back-translation, 

(2) knowledge testing, and (3) performance testing. None of the three 
methods described requires that the experimenter have proficiency in 
the target language, although each approach requires the services of 
linguist-translators. Relatively greater demands are placed on trans- 
lator services in the first two methods than the last; particularly in 
the use of knowledge testing, translators must be used for the basic 
English text, the questions to be answered, and as test scorers. Back- 
translation puts an analytic burden on the experimenter that is not 
present for the other techniques. However, there are no test items to 
be developed for back-translation, while such items are at the heart 
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of knowledge tests. Performance testing may require that a task be 
designed although, as in the present experiments, an available task 
was used. In addition to translators, test subjects are recuired for 
knowledge and performance testing; this is not so with back-translation. 
Only in the case of performance tests are technical experts needed to 
evaluate what subjects do. Similarly, special equipment or material 
is needed for performance tests but not for the other two approaches. 

The relative costs of the three methods are probably in this order 
(low to high): back-translation, knowledge tests, performance tests. 

Finally, confidence in results or validity of the methods is likely in 
the same order. Table 2 summarizes the characteristics of the methods. 

TABLE 2. COMPARISON OF THREE TRANSLATION EVALUATION METHODS 



Characteristic 


Back- 


Knowledge 


Performance 


Translation 


Testing 


Testing 


Experimenter Proficiency 


in Target Language 


No 


No 


No 


Translators Needed : 


Original Text 


Yes 


Yes 


Yes 


Test Items 


No 


Yes 


No 


Scoring Tests 


No 


Yes 


No 


Back-translating 


Yes 


No 


No 


Test Construction 


No 


Yes 


Yes (but may 
use available 
task) 


Technical Experts 


as Observers 


No 


No 


Yes 


Special Equipment 


Needed 


No 


No 


Yes 


Relative Cost 


Lowest 


Middle 


Highest 


Confidence in Results 


Lowest 


Middle 


Highest 


Test Subjects 


No 


Yes — Any 
reader of 
the language 


Yes — must be 
trained in 
the task 
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IV. RESULTS 



This chapter presents the findings of our investigations. The 
first set of data summarizes our study of the speed of translation. 

This section is followed by the section explaining how to assess 
translation quality by means of three methods: (1) back-translation, 

(2) knowledge testing, and (3) performance testing. Also included is 
a short section on how English can be written in such a way as to be 
more easily translatable than the materials used here. 

TRANSLATION SPEED 

The results for translation speed are best presented in graphic 
form with the x-axis representing the order in which tasks were per- 
formed and the y-axis representing the number of words translated per 
hour. Figure 4 shows speed on the five translation tasks that bi- 
linguals performed. Figure 5 shows speed on the three back-translation 
tasks that bilinguals performed. The tasks are arranged in the order 
they were administered. 

There is one assumption involved ir Figure 4. The fifth entry 
on the x-axis represents the efforts of five translators (see Table 1, 
Task 8) who translated at Tasks 1 and 3 on Figure 4, but back-translated 
two times (Tasks 5 and 7, Figure 5) instead of translating two times 
as did those six bilinguals representing Tasks 4 and 6 in Figure 4. 

We assume, however, that the time spent back-translating provided 
similar practice to that obtained by translating, and thus we include 
them as the fifth task in Figure 4. 
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The time designations (or tasks) on the x-axis have either 5, 6, 
or 12 speed scores, corresponding to the numbers in Table 1. 




FIGURE 4. Speed of Translation 
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FIGURES. Back-Translation Speed Scores 



It will be noted that the mean translation speed increases as 
the number of times a bilingual translates or back-translates in- 
creases. Statistical tests (t-tests) reveal that the differences be 
tween the first and last translation tasks are significant at less 
than the .05 level for both translation and back -t ran slat ion . The 
final mean translation speed seems to be about 400 words/hour after 
oractice during early sessions) and the final mean back-translation 
speed seems to be about 450 words/hour after practice during early 
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sessions.* The back-translation speed starts at a higher magnitude 
than translation speed and continues to be higher after several ses- 
sions. The fastest workers can translate over 500 words/hour.** 
Reasons for the faster back-translation will be discussed below. 

More will be said below about the fastest and slowest translators 
under the heading "Relation Between Translation Speed and Quality." 
There was no difference between the speed of translating the conven- 
tional tech order and the job performance aids for the C-141A. 

It is clear from Figure 1 that translation speed increases with 
practice. There is little indication, however, whether or not the 
average speed could exceed 400 words/minute. Several bilinguals were 
asked to translate for several additional sessions (above and beyond 
those summarized in Figure 1), but they did not exceed the 400 words/ 
hour rate after 20 hours more work. However, these men did not have 
such aids as a complete glossary, and thus it remains an open question 
whether or not good translation aids can increase translation speed 
beyond the rates observed in this experiment. 

The 400 word /hour score is slow compared to the often heard re- 
ports of the 12 Vietnamese bilinguals telling us they can translate 
simple prose at 1000 words /hour. This latter rate was not verified 
in these experiments. Of course, the difference between those scores 
lies in the nature of the materials. The technical English translated 
here (examples given in the methodology chapter and Appendices) 



it 

We know of only one comparable study reporting translator rates for 
technical material (Pierce et al. , 1966). The material was scien- 
tific Russian-to-English and translators worked at rates of 240 
words /hour or about 2000 words/day. Brislin (1969) did not record 
exact times, but a rough figure would be 300 words/hour for trans- 
lations between English and Austronesian languages (languages of 
Pacific Islands). The material consisted of prose passages about 
art, child-rearing and ethnic relations. 

** 

This figure is identical with current experience reported from Viet- 
nam: "...The best technical translators can manage 500 words per 

hour--if no special problems arise--for about six hours per day..." 
(Personal communication, January 23, 1970, from Dr. Jack von Dornum, 
International Training Consultants, Inc., Saigon.) 



26 



is much more difficult than the light prose, of say, a Reader T s Digest 
article. Much of the time involved in a translation session is not in 
translating itself, but rather in understanding such complex phrases 
as: "Nose and hydraulic system reservoirs must be properly serviced." 

A further time consuming effort is the thinking of or explaining Ox 
technical words like "hydraulic system reservoirs." Another example 
of an even more difficult sentence is : "Reinstall bolt connecting 

actuator to governor control lever, adjusting actuator shaft rod-end 
to obtain 0.010 inch clearance between governor stop arm and upper 
stop screw, measured with a feeler gage." 

This leads us to an explanation of the faster initial and final 
speed of the back-translators (Figure 5) as opposed to the translators 
(Figure 4). The translators had to spend time understanding the tech- 
nical terms and explaining them in simple Vietnamese. For instance, 
the translators looked at the word "tachometer" and then had to spend 
time understanding that this meant "rotation measuring device." They 
then translated the latter three words to Vietnamese. The back-trans- 
lators had the advantage, then, of not having to spend time explaining 
technical terms since they read the simpler phrasings provided by the 
translators. For instance, they simply read the equivalent of "rota- 
tion measuring device" in Vietnamese, and wrote down the three word 
phrase in English. The back-translators didn’t have to use the word 
"tachometer" at all. 

This transformation of technical English words to simpler English, 
and then to Vietnamese, is called "the explain -around technique" by 
the present investigators. Wickert (1957) noted that he experienced 
the same technique when he asked Vietnamese to translate abstract con- 
cepts. Another example of "explaining around" that we encountersd was 
the translation of the technical term, "by-pass valve." The simpler 
English actually translated was, "a valve used to pass fluid in the 
way not normally used." 
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QUALITY MEASURED BY BACK -TRANSLATION 

Some Vietnamese -English bilinguals translated the technical 
English materials to Vietnamese, and others back-translated to English. 
The back-translated English was analyzed by one of the experimenters. 

This section summarizes his analysis about the quality of the trans- 
lations . 

The 12 bilinguals translated and back-translated three types of 
materials, the T.O. for the UH-1H and C-141A, and the PIMO aids for 
the C-141A. The efforts of the 12 bilinguals were explained previously 
in Table 1. The efforts of these 12 bilinguals produced 9,558 words 
of back -translated English, distributed as follows : 

2400 words of the UH-1H T.O. 

348 6 words of the C-.141A PIMO aids 
3672 words of the C-141A T.O. 

Designation of Errors 

Every word of the back-translated English was compared to the 
original English, as in the following example: 

Original English Back -Translated English 

Man A performs activity Mechanic A carries out the 

(a test) in flight station testing while in flight 

In this example, the only combination of words that caused an error 
in the meaning of the back-translation as compared to the original 
English is the substitution of "while in flight" for "flight station." 
All other words are judged to be equivalent. 

The criterion for an error was simply this: any place in the 

back-translation that is not judged to convey the same meaning as the 
original English is called a meaning error. Meaning errors could be 
of six types: 

1. an addition: a word or phrase in the Lack-translation does 

not have an equivalent in the original 
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2. minor omission: one or two words from the original are 

omitted from the back-translation, and there is nothing in 
the back-translation to replace them 

3. major omission: same as 2, but involving three or more words 

4. garbling: three or more words from the original are garbled 

in the back-translation and are not understandable 

5. minor substitution: one or two words from the original do 

not have an equivalent in the back-translation, but there is 
a phrase to replace the original words. Example: the orig- 

inal "flight station" is back-translated as "in flight." 

6. major substitution: same as 5, but involving 3 or more 

words . 

Finally, the back -translation could be equivalent to the original and 
marked, "O.K." 

Our error analysis does not say anything about the operational 
seriousness of an error. We do not know, for example, whether a 
substitution error or addition of words would result in poor mainte- 
nance to the extent that a helicopter would operate in an unsafe 
condition.* 

Specific Method of Comparison 

Each of the three types of technical materials (described in 
Table 1) was arbitrarily divided into phrases averaging 8-9 words. 

All phrases were either a complete sentence or contained a complete 
thought. For instance, the slash separates the phrases in the follow- 
ing long sentence, and the second sentence forms a phrase by itself: 



* 

There is evidence that errors in tech manuals can cause serious ac- 
cidents. For example, the loss of a U.S. Navy aircraft, in 1969, 
was traced to an improper installation of a safety wire that, in 
turn, was due to "deficiencies in the technical documentation..." 

In addition to the aircraft, eleven lives were lost. (Smith, G.H., 
1970.) 



Open each valve, observing the sight gage /until 
sight gage is free of air bubbles, then close. 

Repeat for all upper valves on both testers. 

Dividing into phrases made it easy to look at a meaningful unit 
m the original and to find the equivalence or non -equivalence of that 
unit in the back-translation. A given phrase could have more than one 
error. Each phrase, then, was tallied into one or more of the six 
error categories, or the "O.K." category. In addition, the exact 
wording that caused each error was noted. 

Since the back-translations of all three types of technical ma- 
terials were examined, comparisons among their back -translation scores 
can be made. This is possible since either all 12 bilinguals trans- 
lated and back-translated the material (as in the UH-1H T.O.), or the 
12 bilinguals were randomly assigned to translate or back-translate 
the material (as in the C-141A PIMO aids and the C-141A T.O.). Thus, 
the quality of the people involved in work on the three types of ma- 
terial should be equivalent, and any differences should be due to the 
nature of each type of material. 

Computation of Quality Scores 

The three types of quality scores used in this experiment will 
be discussed. 

1. The first score is computed by taking the total number of 
meaning errors found in each back-translation and dividing 
it by the total number of original words translated. 

2. The second score is computed by taking the total number of • 
different errors found in the back-translation and dividing 
it by the total number or original words translated. That 
is, since a given back-translation can contain the same error 
made more than once (e.g., the term ’'circuit breaker” omitted 
three times), the number of different errors will be less 
than the total. For instance, in the above example, the 
total score will contain the three omissions of "circuit 
breaker,” but the different error score will contain only 
one error for this series of omissions. 



For instance, a score of 4.5/100 words says that for every 
100 words of original text there are 4.5 words or combination 
of words in error in the b ack-t ran slat ion . However, this 
score does not tell what kinds of errors were made. For this 
reason, a further analysis was made based on what types of 
errors were made within each phrase of the technical materials. 
This analysis constitutes the third type of quality score. 

3. As explained above, the technical materials were divided into 
phrases which were either a complete sentence or a complete 
thought. Each phrase was analyzed to determine what type of 
error was made within it or whether it was rr 0.K. rr If more 
than one error was made within each phrase, the more serious 
error (in the rater’s judgment) was noted for that phrase. 

Thus, if a document had 70 phrases (about 560-630 words since 
a phrase equals about eight to nine words), a certain per- 
centage of the 70 phrases would contain an error, specifically 
marked as to which of the six types of error, and a certain 
percentage would be tr 0.K. TT Cases in which there was more 
than one error per phrase were rare. 

Find ings 

Listed below are several examples of what can happen to a passage 
of moderately technical prose, taken from Chapter 7 of the UH-1H 
manual, "Power Train System." 

First, of course, a translation can be accurate: 

Original : "leaks occurring beyond relief valve could cause some 

indication of low oil pressure." 

Back-translation : "If oil is leaking at the outside of the pres- 

sure relief valve, it can activate the warning of oil low pres- 
sure." 

Second, an omission can occur: 

Original : "This chapter provides all the instructions and in- 

formation necessary for maintenance authorized to be performed 
by organizational maintenance activities on the Power Train 
System. " 
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Back-translation : "This chapter lists all the instructions and 

information necessary for the maintenance of the Power Train 
System. The maintenance has to be assigned to an authorized 
unit." (Note that "organization" is omitted.) 

Third, the translator makes a substitution: 

Original : "...two gear boxes through which the tail rotor is 

driven..." 

Back-translation: "These gear boxes activate the tail fan 

blade." 

Fourth, translators garble terms that result in definite changes 
of meaning; and leave an ambiguous, sometimes nonsensical, phrase 
in the back translation. 

Original : "Troubleshooting precautions." 

Back-translation : "Preventions while repairing." 

The average number of words or combination of words in error per 
100 words (quality score 1) and the average number of different words 
or combination of words in error per 100 words (quality score 2) are 
presented in Te ble 3 for each of the three types of technical material. 
The numbers of translators and back-translators who were involved in 
working on each type of material are also given, as are the total 
number of words on which the error scores are based. The reliability 
of the back-translation examination technique is adequate. An in- 
dependent rater examined the 12 back-translations of the UH-1H ma- 
terial. Agreement between the two raters resulted in high reliability 
coefficients: r = .88 for the number of errors per passage; r = .94 

for the number of different errors . 

The analysis of errors by phrase (quality score 3) is presented 
in Table 4. The numbers of translators, back-translators, and words 
are the same as in Table 3. The "total phrase" figure in Table 4 
represents the total number of phrases that all bilinguals working on 
that type of material translated. For instance, if a document had 60 
phrases and six bilinguals translated all 60, the "total phrase" fig- 
ure would be 360. 
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TABLE 3 



. TOTAL NUMBER OF ERRORS PER 100 WORDS AND NUMBER OF 
DIFFERENT ERROF^S PER 100 WORDS* 



Type of Material 

UH-1H T.O. 

12 translators 
12 back-translators 



C-141A T.O. 

6 translators 
6 back-translators 



C-141A PIMO Aids 
6 translators 
6 back-translators 



No. of Errors* No. of Different Errors* 
Per 100 Words Per 100 Words 



5.5 5.0 

Based on 2400 words 

6.9 4.6 

Based on 3486 words 



6.3 • 4.3 

Based on 3672 words 



An error refers to a word or a series of words in the back-translation 
that is different from the original. 



TABLE 4. PERCENTAGE OF ERRORS AND CORRECT TRANSLATIONS 
ANALYZED BY PHRASE FOR THE THREE TYPES OF 
TECHNICAL MATERIAL 



Type of Material 


Addition 


Minor 

Omission 


Major 

Omission 


Garbling 


Minor 

Substitution 


Ma j or 

Substitution 


O.K. 


Total 

No. 


UH-1H T.O. 


1.8 


14.9 


9.8 


4.0 


13.4 


2.2 


54.0 


276 


C-141A T.O. 


1.5 


10.1 


2.5 


2.3 


31.7 


6.0 


45.9 


397 


C-141A PIMO 
Aids 


2.1 


10.9 


6.1 


1.9 

f 


30.3 


5.1 


43.6 


376 



The data in Table 2 are similar for all three types of technical 
material, especially the number of "different errors." The striking 
feature about the data in Table 4 is the similarity of the seven 
scores (six error and one "O.K.") for the C-141A T.O. and the C-141A 
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PIMO aids. In only one case is there more than a 2% difference be- 
tween corresponding scores. The UH-1H T.O. "O.K." score of 54% is 
about 8% above the scores for the two C-141A materials, but this dif- 
ference is not statistically significant (p. > .10). There are more 
major and minor omissions in the UH-1H T.O., but not a statistically 
significant (p. > .10) difference. One other difference worth noting 
is the greater number of minor substitutions in the UH-1H T.O. com- 
pared to the two materials for the C-141A. This difference is sta- 
tistically significant (p. < .05). 

The most striking feature of Table 4, the similarity of the seven 
scores for the C-141A T.O. and C-141A PIMO aids, fits in well with 
other findings which show that there is little or no difference in 
either speed or quality of translation for these materials . In the 
section on "translation speed" it was noted that bilinguals translate 
the PIMO aids and T.O. for C-141A with equal speed. In a following 
section it will be shown that Vietnamese Air Force enlisted men can 
answer questions about a mechanical system with equal accuracy whether 
they read the C-141A T.O. or the C-141A PIMO translation into Viet- 
namese . 

The statistically significant difference in the number of substi- 
tutions contained in the UH-1H T.O. compared to the two C-141A ma- 
terials deserves discussion. It must be remembered that the UH-1H 
materials were translated first. The bilinguals were learning un- 
familiar material and made more errors of omission and garbling than 
they did later with C-141A materials . Errors of omission and garbling 
refer to places in the original that have either an absence of or an 
unintelligible corresponding phrase in the back -translation . While 
working later on the C-141A materials, they lessen these errors of 
omission and garbling but commit more errors of substitution in which 
there i_s a corresponding phrase in the back-translation. What may be 
happening in the later efforts, then, is that bilinguals are attempting 
more translations of difficult words, leading to substitution errors. 
They are doing this rather than not trying at all or making poor at- 
tempts, leading to omissions and garblings . 
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Procedures for Dealing With Unfamiliar Terms 

Translators in out experiment did one of three things when they 
came across unfamiliar words in English or words for which there were 
no Vietnamese equivalents : 

1. They left the English word intact in the translation; this is 
net a good solution because of low English comprehension 
levels among technicians, 

2. They transliterated the word into Vietnamese (e.g., "piston" 
becomes "pit tong"), 

3. They coined terms to describe, in a functional way, the 
English word or concept (e.g., "bypass valve" becomes "a 
valve used to pass fluids in the way not normally used.") 

This is the "explain around" technique, previously described. 

QUALITY MEAS3URED BY KNOWLEDGE TESTING 

In the knowledge testing technique, subjects read a translation 
and then answer a set of questions written about the passage. If the 
questions can be answered, the translation is assumed to be a good 
one. Knowledge test scores, based on different translations of the 
same original material, permit comparisons of translation quality. 

Two knowledge testing experiments were run, each using different 
subjects and materials. 

In the first experiment three translations of the same material 
from the Army f s tech manual for the UH-1H helicopter were chosen that 
were thought to be of different quality. The quality ranking was 
based on the number of errors in the back-translation, the quality 
assessment procedure presented earlier. That is, translation A had 
fewer back -translation errors than translation B, and translation B 
had fewer errors than translation C. In addition, a Vietnamese linguist 
read the original English and the three translations, and then rank- 
ordered the translations from best to worst. His rank -ordering was 
the same as that based on the number of back-translation errors. 
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The knowledge test consisted of 10 questions written about the 
passage by the experimenters and translated into Vietnamese. Appendix 
B contains the passage and the 10 questions. The same 10 questions 
were to be answered after subjects read one of the three translations. 
Since the questions were the same, any differences in the number 
answered should be due to the quality of the translations. 

Subjects were 68 Vietnamese Air Force enlisted men being trained 
m helicopter maintenance at Ft. Eustis, Virginia. These 68 subjects 
were asked to answer the 10 questions after being randomly assigned to 
read either translation A (N = 22 men), B (N = 23 men), or C (N = 23 
men). Subjects had both the passage and the 10 question- in front of 

them throughout the one-half hour testing session so that memory was 
not a factor on this test. 

The second experiment was designed to compare the answering of 
questions about translations of PIMO aids with those for the conven- 
tional USAF technical order for the C-141A aircraft. A single bi- 
lingual translated both the PIMO aids and the T.O. He alternated be- 
tween .sections of one document, then of the other, so that he would 

not translate one document better simply because he had practiced on 
the other. 

The questions to be asked about the passages were translated into 
Vietnamese by the same bilingual. Six of the questions were the same 
for the T.O. and PIMO material since the same topic was covered in the 
passages under study. (Specifically, the topic was the maintenance of 
the normal and emergency brake system.) These six questions allowed 
a range of 0-21 points. The other questions, also representing 21 
points, were different for the PIMO and T.O., i.e., they were unique 
to each passage. The "different” questions were added to increase the 
range of scores. An individual could thus achieve a score of 0 to 42. 
The major comparison between the PIMO and T.O. would be in the "same" 
questions since the same bilingual translated all test materials. Any 

differences in scores would be in the nature of the PIMO aids or the 

T.O. 
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Subjects were 36 Vietnamese Air Force enlisted men being trained 
in helicopter maintenance at Ft. Eustis, Virginia. They were asked to 
read either the PIMO or the T.O., and thus there were 18 subjects in 
a group. Subjects had both the passage and questions in front of them 
for the one -half hour testing session. All tests, in both experiments, 
were scored by a Vietnamese linguist. 

Findings 

Table 5 gives the results of both knowledge testing se c :ions. 

For session 1, where a perfect socre is 10, it can be seen that sub- 
jects were able to answer more questions about translation A than B, 
and more about B than C. This rank -ordering is the same as that found 
by errors in the back -translation and by the judgments of a Vietnamese 
linguist. Differences among all combinations of the three means (A 
versus B, A versus C, B versus C) are statistically significant (p. < 
.01). These results show that the knowledge test is sensitive enough 
to demonstrate differences in translation quality. 



TABLE 5. TRANSLATIONS EVALUATED BY KNOWLEDGE 
TESTING : TWO EXPERIMENTS 



Translation 


No. of 
Subjects 


Mean 

Score 


Standard 

Deviation 


Experiment 1: Comparison 


of three 


translations 


of UH-1H TM 


A 


22 


6.1 


2.2 


B 


23 


4.3 


1.8 


C 


23 


2.6 


1.3 



Experiment 2: Comparison of 


PIMO 


and T.O. translations for 


C-141A 

PIMO 


Total score 




34.8 


3.3 


Same questions 




16.2 


3.7 


Different questions 


18 


18.6 


1.2 


T.O. 


Total score 




33.2 


6.7 


Same questions 




16.1 


2.9 


Different questions 


18 


17.1 


4.7 



37 



For session 2, the data toward the bottom of Table 5 show that 
the translation of the PIMO aids and the T.O. for the C-141A allow 
the same number of both the same (perfect score is 21) and different 
(perfect score is 21) questions to be answered. Thus the total number 
of questions (perfect score is 42) are also the same for the T.O. and 
PIMO aids. The very small differences are not statistically signifi- 
cant (p . > .10) . 

Two points can be noted on the basis of the knowledge testing. 

1. The rank ordering of translation quality according to the 
knowledge test is the same as that derived from comparisons 
of the original and back-translation. The latter method, 
however, is less expensive and less time consuming, since a 
researcher does not have to gather subjects to respond to a 
knowledge test. There is, of course, a trade-off between 
confidence in the methods and cost,, Back-translation is less 
expensive but does not provide as much confidence in quality 
assessment as knowledge testing. Both knowledge testing and 
the original back-translation comparison method seem sensitive 
enough to differentiate among translations of unequal quality. 
Note that both the knowledge testing and the back-translation 
comparison methods allow a person who doesn T t speak Vietnamese 
to evaluate translation quality. 

2. There seems to be no difference between translations of the 
T.O. for the C-141A and the PIMO aids as shown by the 
knowledge test. The translation speed scores and transla- 
tion quality scores (through back-translation comparison) 
also showed no differences. Thus, the PIMO type of format 
offers no advantages in translatability over the conven- 
tional T.O. 

RELATION BETWEEN TRANSLATION SPEED AND QUALITY 

Translation speed and translation quality have been dealt with 
separately in previous sections. In this section we would like to 



38 



summarize our inquiry into whether or not there is any relation be- 
tween speed and quality. That is, if a translator is fast, can we 
predict how good his translation will be? Or, if he translates with 
few errors, can we predict how fast he works? 

Correlations were computed comparing the number of errors found 
by comparing the original against the back -translation and several in- 
dices of speed. Several speed indices were necessary since the back- 
translation product is due to two efforts: (1) the original to the 

translation step, and (2) the translation to the back-translation 

step. Each of these two steps has a corresponding speed score. The 
three indices of speed were: 

1. speed of the original to the translation step 

2. speed of the translation to the back -translation step 

3. average speed involved in the two steps 

The first index, speed of the original to the translation step, 
is most important for the analysis of a speed -quality relation, and 
the other two indices are clearly of less practical significance. The 
other speed indices, however, were compared with the quality score to 
examine the relation in more depth. Each of the three speed indices 
was compared to the back-translation error score for each of the three 
types of technical material. Thus, there were nine correlation coef- 
ficients: three for the UH-1H T.O., three for the C-141A T.O., and 

three for the C-141A PIMO aids. 

The correlation coefficient used was the Spearman Rank Correla- 
tion Coefficient (Siegel, 1956, pp. 202-213). A Spearman coefficient 
of 1.00 would show perfect correlation between speed and quality (the 
fastest are the best and the slowest are the worst). A coefficient 
of -1.00 would show perfect agreement in the negative direction (the 
fastest are the worst and the slowest are the best). A coefficient 
of 0 (zero) would show no relation between speed and quality. 
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Findings 



The range of the nine correlation coefficients, all shown in 
Table 6, was r = -.88 to r = .50. The only statistically significant 
coefficient of the nine was the r - -.88 figure. There is an indica- 
tion that conventionally written technical material for the C-141A 
tended to be translated more accurately by the slower translators and, 
conversely, the faster translators were less precise. 

TABLE 6. CORRELATIONS BETWEEN SPEED AND QUALITY FOR TRANSLATIONS 

AND BACK -TRANSLATIONS 

Type of Technical Material 



Translation Step 


UH-1H T.O. 


C-14XA T.O. 


PIMO for C-141A 


Speed of Original to 
Translation 


-.20 


-.88 


.23 


Speed of Back-Transla- 
tion to Translation 


.50 


.09 


.09 


Average Speed (Combined 
Forward and Back- 


-.21 


-.60 


.14 



Translation) 



With that one exception there seems to be little relation between 
translation speed and translation quality. Whether a translator is 
fast or slow, we can tell little about the quality of his translations. 
Likewise, whether his .ransiations are of good or bad quality (as 
shown by back-translation error scores), we can tell very little about 
his speed. The factors of translation speed and of translation quality 
seem to be independent . Perhaps the independence between speed and 
quality reflects the restricted range of translator ability. If a 
wider range or skill were sampled a speed-quality relation might be 
demonstrated. 



QUALITY MEASURED BY PERFORMANCE TESTING 

Although it is a much more expensive and time-consuming approach 
to evaluating translations, the technique of observing men work with 
translated material comes closer to m ultimate criterion of the value 
of translations than any other method. In addition to being slower, 
the administration of performance tests yields relatively less data 
than the other techniques we have used. But, the technique is at- 
tractive because it provides straight-forward information that is easy 
to interpret: men do a task which is dependent on written material 

and their performance is objectively scored. Good performance means 
that the writing was useful and vice versa. In cur experiments, teams 
of technicians carried out a very demanding adjustment task on a por- 
tion of the UH-1H helicopter main power plant.* Observers, U.S. Army 
sergeants who were both experts ir helicopter maintenance and instruc- 
tors on the system to be adjusted, assessed each of 12 steps in the 
task as "Error free", "Minor performance error", or "Major error." 

"Minor errors" were those steps that the crews did wrong, but then 
corrected themselves; "major errors" were noted if crews did not know 
how to proceed or if their performance was so far off that it required 
intervention by the observers. 

In addition to error scores, we recorded the time taken by each 
crew to do the 12 steps in the adjustment task. (In one translation 
condition, in which major errors were frequent, time measurement be- 
came impossible because the observers had to step in often to assist 
the crews.) 

There were four experimental language conditions: (1) the standard 

or original English technical manual; (2) a very high quality transla- 
tion, and (3) and (4), two lesser grades of translation. The high 
quality translation was produced as follows: two of our best trans- 

lators each worked independently, then they reviewed each other T s work 



Sect. 5-391 "Adjustment — Power Turbine Governor RPM Controls," U.S. 
Army Tech Manual TM~ S5-152Q-21Q-20. (See Appendix A for English 
and Vietnamese texts.) 
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and wrote a r consensus” translation. Finally, our linguist consultant 
reviewed and modified their combined effort. The translators had 
available two bilingual glossaries of technical terms, i.e., helicopter 
and automotive.” (We refer to this translation as "supervised.”) 

The first of the lesser quality translations was done by a free- 
lance, highly qualified translator to whom we gave copies of the same 
technical glossaries mentioned above. This man was paid a fixed fee 
and he worked without review. (We call this the "free lance transla- 
tion.”) The second of the lesser quality translations was obtained by 
contracting with a Washington translation services company for a fixed 
fee to have the approximately 1000 words of English translated. We 
had no control of the method used by the translator nor did he have 
access to any glossaries or other aids. Since he was paid a fixed fee, 
we assume the translator worked as fast as possible. His work was not 
reviewed. (We call this the "commercial translation.”) It is important 
to note that both the free lance and commercial translators were highly 
qualified translators, each being a member of the staff of the Voice 
of America. (Appendix A contains copies of the original English corpus 
and the best t ran sic “ion. ) 

Crews used as subjects were assembled from two groups of men at 
the U.S. Army's Transportation School, Ft. Eustis, Virginia: (1) 

Vietnamese airmen who had just completed the Army's aircraft main- 
tenance and helicopter repairman courses, and (2) U.S. Army enlisted 
technicians who were also newly graduated from the same courses. Viet- 
namese airmen were assigned randomly to one of the four language con- 
ditions. Four classes of VNAF airmen furnished subjects and we have 
assumed that there were no qualitative differences among or between 
these groups. In each language condition shown there were six three- 
man crews, each of which worked independently.* ** The American Army 
technicians, who worked in English, are included for comparison. 

* 

Ft. Eustis, Virginia, 1969; Training Aids Division, 1967. 

** 

Data for one crew, commercial translation, were lost because that 
crew was unable to follow the translation. 
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Findings 

Table 7 illustrates several striking things about translated 
technical material . 

TABLE 7. PERFORMANCE TEST RESULTS: ACCURACY 



Experimental Condition 


Error 
Free, ' 


Major Errors 
% Committed, % 


Vietnamese : 


Supervised Translation 


73.1 


5.6 


Vietnamese : 


Free-Lance Translation 


40.3 


4.2 


Vietnamese : 


Commercial Translation 


11.0 


37.0 


English (VNAF Subjects) 


40.7 


20.6 


English (U. 


S. Army Subjects) 


73.2 


0.0 


First, 


it is clear that working 


in one T s own 


language , even in 



translation, is significantly better than having to use a second 
language. The difference is significant by chi-square at less than 
the .01 level. However, an important qualification is that a transla- 
tion must be high quality. Second, the performance task is sensitive 
to the quality of translation: commercial quality produced much higher 

rates of serious errors than the English text. That is, the Vietnamese 
airmen worked more effectively with English than they did using a poor 
translation (p. < .05). Third, the quality of translated technical 
documents, as measured by performance, is directly influenced by the 
procedures of the translators. Thus, using a group of men who were 
approximately equal in their bilingual abilities as translators we 
were able to produce very different levels of material. The mode of 
compensation, i.e., placing a premium on speed, was one procedural 
variable. The availability of bilingual glossaries of technical terms 
was another, and probably the most important, reason. Incorporation 
of team translation and a review procedure seemed to make a difference. 
Fourth, the careful translation procedures outlined here can lead to 
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documents that allow Vietnamese mechanics to perform as well as U.S. 
Army mechanics. 

As an example of what can happen to less than thorough transla- 
tion, a partial analysis of the commercially prepared document showed 
at least two serious errors: (1) an entire sentence was omitted from 

one paragraph; and (2) the translator substituted ”... British centi- 
meters...” for the correct ”... inches .. .” each time a measurement di- 
mension was given. 

Where it was possible to make measures of time required for the 
performance task, working in a familiar language was advantageous 
(Table 8). While it is clear that the VNAF subjects working in Viet- 
namese spent less time than when they worked in English, the time 
measures within the three Vietnamese translation conditions do not 
lead to straight-forward interpretation. 

TABLE 8. PERFORMANCE TEST RESULTS: SPEED 



Experimental Condition 


Mean Time 
Minutes 


Vietnamese : 


Supervised Translation 


37 


Vietnamese : 


Free-Lance Translation 


27 


Vietnamese : 


Commercial Translation 


* 


English (VNAF 


Subjects) 


45 


English (U.S. 


Army Subjects) 


22 



Excessive error rate precluded making meaningful 
measures. 
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SUBJECTIVE OPINIONS AND TRANSLATION QUALITY 

An interesting fact emerged from discussions with some of the Viet- 
namese airmen who used the best translated material. Most of the men 
we talked with after they had worked on the performance task expressed 
a dislike for the translations. The principal objection seemed to be 
that there were unfamiliar Vietnamese terms used for some of the tech- 
nical English words. To paraphrase the words of some subjects, rr ...we 
did not understand all the Vietnamese words. We would prefer to use 
the English manual on which we had been trained. rr It is particularly 
noteworthy that, in spite of their expressed dislike of even the best 
quality translation, the measured performance of these airmen was 
nearly equal to that of the American technicians. Similarly, we asked 
two bilingual readers (one of whom was an expert in helicopter main- 
tenance) to review and comment on one of the unaided commercial trans- 
lations. Both of these men thought that the document was rt pretty 
good." However, in practice, it produced the worst performance of any 
of the language conditions. The point we wish to underscore is the 
discrepancy between subjective assessment and performance testing as 
ways of evaluating translations. The verbal reactions of our subjects 
and of the linguists were reversed when we went to performance obser- 
vations, as shown in Table 9. 

TABLE 9. ASSESSMENT OF TRANSLATIONS: SUBJECTIVE 

OPINION VERSUS PERFORMANCE 

Subjective Opinion 
VNAF - rr Don T t like translation" 

Bilingual reviewers - "Not bad" 



Performance 
Very Good 
Poor 



Clearly, subjective opinion and performance do not predict the 
same thing and we strongly endorse the latter method as the more valid 
way to test translations. 
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V. COST OF TRANSLATION 



Not only are skillful translators in short supply, but their 
services are expensive. We paid each of our 12 Vietnamese translators 
$8.00 per hour. At a daily rate, and assuming productivity of 2400 
words of technical material processed per day by a single translator, 
1000 words of English-to-Vietriamese would cost about $27.00. This 
figure does not include review or other quality control costs or over- 
head . 

Commercial translation services are available, but are in very 
limited supply for technical material. The free-lance translation and 
the commercially supplied translation (used in the performance test) 
cost $30 to $39, respectively, for just under 1000 words. Again, 
neithe:? of those products was reviewed for accuracy. 

Some data are available on translation costs for languages other 
than Vietnamese. Based on a 1965* analysis of the USAF Foreign Tech- 
nology Division 1 s experience with translating scientific Russian to 
English, 1000 words cost about $40. This is based on an in-house, 
i.e., Civil Service, translation staff and about 60% of the figure 
goes to salaries. Since the average middle grade pay has increased 
approximately 75% since the Pierce Committee T s report, a reasonable 
current estimate would be about $60 per 1000 words of scientific 
Russian. 

We believe that the costs incurred in the present study for the 
best quality translation, i.e., $140 per 1000 words, could be reduced 



Pierce, J.R., et al. , "Language and Machines," National Academy of 
Sciences, Washington, D.C., 1966. 



by about half. The means for achieving a lower rate are beyond the 
scope of this study but we suggest, tentatively, that the following 
steps would serve to provide a high quality, reasonably priced English- 
to-Vietnamese translation service: (a) compensate translators on a 

piece rate basis but insist on quality work; (b) spot check quality 
via one or more of the techniques described in earlier sections of 
this report (e.g., back-translation or knowledge testing*) and adjust 
compensation to the results of the quality check; (c) always have 
every translation reviewed by the best available bilinguals; (d) de- 
velop and provide bilingual technical glossaries covering the substan- 
tive areas being translated; (e) when feasible, try to provide some 
technical indoctrination for translators such as a brief orientation 
course, demonstrations of the equipment, and so on. 



Performance testing is too expensive to be used as a regular 
control. 
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VI. WRITING TRANSLATABLE ENGLISH 



Having - demonstrated some of the errors that occur in translation, 
we asked, f7 Can the original technical English be written so that it is 
more easily (i.e., accurately) translated? 77 To provide tentative 
answers, the back-translations of 12 Vietnamese bilinguals were in- 
vestigated in order to see what problems they encountered. If cer- 
tain aspects of the original English (such as the use of long sentences) 
often caused translation problems, it could be assumed that these as- 
pects should be changed in order to secure good translations in the 
future. Each time there was an error in the back-translation, we 
looked at the original English to decide what caused the poor transla- 
tion. Perhaps the problem was long sentences. If the monolingual 
finds that the same aspect, long sentences, causes errors in different 
parts of the original English text and causes errors by different 
translators, then he can assume with some confidence that the aspect 
does indeed cause poor translations. 

This method of examination was applied to the 9558 words trans- 
lated and back -translated by the 12 Vietnamese bilinguals. Eight as- 
pects of the original English seemed to cause problems, and these 
problems can be alleviated by rewording the English. The findings 
permit a list of rules for writing translatable English to be formed. 

Based on our analysis of back-translations, the following rules 
for writing translatable English can be suggested. All examples are 
from the corpus described in Chapter III, "Methodology. 77 

1. Use short sentences of less than 16 words . Our analysis 

demonstrated that sentences of more than 16 words translated 
poorly. 
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2. 



Separate nouns rather than string them together . It is wrong 
to write such phrases as : "organizational maintenance 

activities"; "low oil pressure indication"; "ground safety 
pins"; "trouble-shooting precautions." 

3. Use the active rather than the passive voice . Several pas- 
sive voice forms that were poorly translated are: "will 

not be shown by; must be installed." 

4. Write words completely rather than abbreviate . These ab- 
breviations led to confusion: "D.C., Landing Gear Cont." 

5 . Avoid adverbs and prepositions telling "where" or "when" if 

possible . These prepositions and adverbs were poorly trans- 
lated: "reasonably probable" ; "frequent"; "beyond"; "upper." 

6. Avoid possessive fo. its where possible . Examples are-: "sys- 

tems and components of power train"; "dust caps from ends of 
tester hose." 

7 . Use one -syllable rather than poly-syllabic modifiers where 

possible . Examples of poorly translated poly-syllabic modi- 
fiers are: "indicated oil pressure"; "unusual chain of 

events ." 

8 . Use specific terms rather than vague words . These vague 

words were poorly translated: "properly serviced"; "install" 

(how install?); "fluid" (what kind of fluid?). 

Several phrases in the corpus were translated perfectly by all 
bilinguals. A few of these will be listed. Note how they follow the 
above rules almost perfectly. 

1. "This chapter provides all the instructions and information." 

2. "Effects of an oil leak will depend on its location in system 
and rate of leakage." 

3. "Man A and Man B should be in communication with each other 
during the test." 
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4. "Open each valve, observing the sight gage until sight gage 
is free of air bubbles, then close." (NOTE: The redundancy 

of using "sight gage" twice is good practice in writing 
translatable English.) 

One phrase was translated very badly by all bilinguals. The 
rules this phrase breaks are noted in parentheses. 

Install the pilot T s and copilot T s (rule 6) 
rudder pedals behind (rule 5) the rudder tension 
regulator (rule 2)." 

Finally, certain aspects of the PXMO materials in their present 
form translated well. 

1. The command form of the verb in the PIMO aids provided good 
translations, e.g,, " place short tester hose" j " repeat for 
all upper valves." 

2. When the other eight rules were followed, the short sentences 
in the PIMO aids translated well. 

We suggest that the foregoing rules, applied to manuals in the 
English language and intended for use by U.S. military personnel, 
will improve their readability as well. 
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APPENDIX A 

UH-1H TECHNICAL MANUAL 
(TM-55-1520-210-20), Section 5-391 

and 

BEST VIETNAMESE TRANSLATION 
(Referred to in Text as TT Supervised Translation”) 



NOTE: Steps b. through m. formed the performance 

test reported in this paper. 
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5-391. ADJUSTMENT - 
ERNOR RPM CONTPOLS. 



POWER TURBINE GOV- 



h. Disconnect actuator shaft from governor 
control lever (17) by removing bolt. 



a. Be sure collective pitch control system 
rigging has been completed. 



i. Electrically position actuator shaft to ap- 
proximate midpoint of stroke. 



b. Lock collective pitch control stick in full 
down position and, adjust droop compensator control 
tube (2, figure 5-77) to align center of bolt hole in 
aft arm of torque tube (4) approximately level with 
top of support bracket (11). Due to shimming, man- 
ufacturers tolerance, etc., variation of 0.250-inch 
from top of support bracket is possible and accept- 
able. (See detail B. ) 



c. Set cam adjustment (15) to middle of slot. 
(See detail D.) 

d. Move collective pitch control stick to full 
up position and lock. '> 



(1) If actuator with two adjusting screws is 
installed, turn both positive stop adjusting screws to 
obtain maximum stroke (see detail E). Reduce stroke 
by turning, each screw ten full turns away from 

maximum adjustment to obtain actuator nominal 
position. 

. (2) If actuator with single adjusting screw 
is installed it is not necessary to adjust positive 
stop screw to obtain nominal position. Positive stops 
can be adjusted, if necessary, for travel of 0.500 
inch to 1.75 inch without change in nominal position. 



Note 



e. Adjust control rod (12) attached to cam 
bellcrank so that approximately 0.25-inch of cam 
stot is visible below cambox housing for T53-L-9, 

-9 A, -11, and -11B engines; 0.38-inch for T53-L- 
13 engines. 



One full turn of the adjusting screw will 
cause a change in both the retract and 
extend position of .032 inch. (See detail 
E.) 



This is a nominal setting and is subject 
to change, if necessary, in following steps. 

f. Check installation of governor control lever 
(17) as nearly at 90 degree angle to stop arm as 
serration alignment permits. (Refer to paragraph 
5-386 step a.) 

g. Adjust upper governor stop screw to 0.250- 
inch for T53-L-9 and -9A engine; 0,210-inch for 
T53-L-11, -11B, and -13 engines, measured from 
inner side of mounting boss. (See detail C.) Remove 
and discard lead seal on lockwire, if existing. 



Note 



Never shorten either stop screw on gov- 
ernor to less than 0.060 inch length from 
inner side of boss. 



Note 



Set actuator travel to; 1.38-inch for 
T53-L-9, -9A engines; 1.25-inch for 
T53-L-11 series engines; 1.20-inch for 
T53-L-13 engine. 



j. Fully retract actuator shaft by holding GOV 
RPM switch to INCR. Move collective stick to full 
up position. 

k. Reinstall bolt connecting actuator to gov- 
ernor control lever, adjusting actuator shaft rod- 
end to obtain 0.010 inch clearance between governor 
stop arm and upper stop screw, measured with a 
feeler gage. (See detail C.) If necessary, reposi- 
tion control lever one serration on governor shaft 
to accomplish this adjustment while keeping safe 
thread engagement of rod- ends. 






Note 



When tightening jamnut on actuator shaft, 
center rod- end in clevis of lever so that 
self-aligning bearing will absorb any ro- 
tation of shaft, 



l, Fully extend actuator shaft by holding GO^ 
RPM switch to DECR. Lock collective pitch control 
stick in full down position, 

m, Adjust lower stqp screw for 0.010 inch 
clearance with governor stop arm, measured with a 
feeler gage. Remove and discard lead seal on lock- 
wire, if existing. Observe minimum length limita- 
tion.. (Refer to Note under step g,) 

n. On initial ground run, with collective pitch 
control stick full down, check for 6000 to 6700 
(±50) rpm range controlled by GOV RPM switch, 
If necessary, readjust actuator stroke length to 
obtain required range, repeating clearance checks 
and adjustment at both governor stop screws, 

o. Make final adjustments of droop compen- 
sator cam as required by flight checks. Set cam to 



maintain 6600 nil rpm (plus or minus 40) from full 
low pitch to full power, K rpm droop occurs, rotate 
cam counterclockwise toward maximum compensation. 
If maximum compensation adjustment does not cor- 
rect droop, lengthen control rod (12) to increase 
amount of cam slot showing below housing. Be sure 
roller does not bottom out at end of cam slot in 
either extreme of travel. 



Note 



Readjust governor stop screws for clear- 
ance after any change in rigging. 



5-386. INSTALLATION - ACTUATOR AND CON- 
TROL LEVER. 

a. Place control lever (17, figure 5-77) on 
governor control shaft (18) as nearly at 90 degree 
angle to centerline of shaft stop-arm (19) as ser- 
rations permit. Install retaining bolt, with washer, 
from aft side into lever and through shaft groove. 
Lock-wire bolt head to shank of lever. 



1. Collective Pitch Bellcrank 

2. Control Tube 

3. Bracket Assembly 

4. Torque Tube 

5. Shear Fitting 

6. Bellcrank 

7. Shear Pin 



8. Shims 

9. Retaining Washer 

10. Firewall Seal 

1 1 . Support 

12. Control Rod 

13. Cambox Bracket 

14. Cambox Assembly 



15. Cam Adjustment 
,16. Linear Actuator 

17. Control Lever 

18. Governor Control Shaft 

19. Shaft Stop- Arm 

20. High RPM Stop 

21. Low RPM Stop 
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F igure 5-77. Power turbine governor rpm controls (Sheet i of 2) 
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. SET UPPER STOP 




0.25 FOR T53-L-9/-9A/-11 /-I IB 
ENGINEf 

0.38 FOR T53-L-13 ENGINE 



DETAIL B 
RIGGING POSITION AT 
FULL UP COLLECTIVE 



205060-10D 
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Fifpjr* 5-77. Power turbine governor rpm controls (Sheet 2 of 2) 
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MWiiHita 




» 

*5-391 Cach Dieu Chinh - Bo Phan Dieu Kh .en 
Luc Tua-Bin 




< A A f J ** <* • / 

a. Kiem lai cho chac he thong doi sai chung da dtjfoc rap xong. 

b. Khoa can doi sai chung vao vi tri cao nhat, va dieu chinh ong dieu khien 

4 \ S ICC ^ ^ 1 * ' Q W j n A^ 

b'o boi hoan/(2, hinh 5-77) de sua aho trung tam ciia 16 bu-lon d tay sau cua ong 

* / I— 2. *2 f * ^ ^ . 

soan (4) gan cao ngang voi dinh cua gia do* (11). Nh3 co la chem va do dung sai 
cua nha san xuat, van van... nen sij xe dich khoang 0.250 phan Anh (inch) til dinh 

gia dd cd the xay ra va cuing chap nhan diidc. (Coi chi tiet B) 



c. 



d. 



Xoay bo dieu chinh cam (15) vao chinh giua lo mong (Coi chi tiet D) 
* * « 

K-u can doi sai chung xuong vi tri thap nhat va khoa lai'. 



e. Dieu chinh then dieu khien(12) gan lien vdi tay chuyen liic cam de . / 

khoang 0.25 phan Anh cua lo mong cam nay .. ' 1 * •• , d phia diloi hop 

dia cam cho cac loai dong c6 T53-L-9, -9A, -11, va -11B ; khoang 0,38 phan Anh 
cho cac loai dong cd T53-L-13. 

Tren ddy la each sap dat thong thuong, va neu can, co the dude thay doi 
theo cac bride chi. dan sau day: 



t'i 



in. e 



f. 



Kiem diem lai viec y£ap can dieu khien bo tiet che (17) cd dung gan goc 
90 do doi voi tay ham . viec dieu chinh sri cua dridng rang cua cho 

phep (Coi lai doan 5-386 bri&c a.) htliVi 

6 d 

g. -Dieu chinh dc ham tren cua bo tiet che khoang 0.250 phan Anh cho loai dong 
co T53-L-9 va -9A ; khoang 0.210 phan Anh cho cac loai dong cd T53-L-11, -11B 
va -13, do tu phia ben trong cua loi gain trd ra (Coi chi tiet C). 4 Thao bo kep chi 
tren gray kern ham, neu co. 

GHI CHU 

' A s * A ^ At A n a ^ a ^ A * ^ ^ 

Dung bao gio van bat cu oc ham nao tren bo tiet che xuong qua muc 

a' • ,'*■ / «V- * 1 

0.060 phan Anh ke tu phia trong loi gan tro ra. 
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h. Tech true tac ding khSi can di3u khiin bo tiet che' (17) birig each tha'o 
bo bu-lon 



i. ^Dun^dien xoay true tac dong vao vi tri gan dung trung diem cua thi* 
chuyen dong 

Cite. 

* % 

■ <1 )^Neu xu’dung bo tac dong ci 2 6c die"u' chlk, thi van oa 2 6c ham dieu' 

chinh duong de co ddoc thi chuyen dong toi da(coi>chi tiet E). Hay, giam 

, thi chuyen dong baig each van ngude m&i 6c ham 10 vo'ng khoi vi tri'diSi chinh 
. :• ‘ toi da de co duoc vi tri tac dong thong thddng. 

(2)^ Ne u xU dung bo tac dong cp;.mot oc dieu chinh thi khoi can phai dieu 
chinh oc ha'm dieu chinh dUong «deW^vi tri ’thong thddng. NeV can, cac nac ' ! 
ham diiong co the dUdj: dieu chinh de di chuyerT trong vong 0.500 phan Anh 
den 1.75 phan Anh ma" khong can phai thay doi vi tri" thong thuong. 

f * 

„ ' GHX CHU ; 

Mot vong ,,oay cua oc dieu chidh se lam thay doi ca vi tri thu hep va i 
n6i rong khoang 0.032 phan Anh (coi chi tiet E) • 

/ 

GHI CHU 

-Dieu chinh khoang di chuyen bo tac dong nhu sau: 1.38 phan Anh cho cac 
dpng co T53-L-3 va -9A ; 1.25 phan Anh cho loat dong c6 co' so'loai 
T53-L-11 ; va 1.20 phan Anh cho dong co TL3-L-13. 

i 

j. ihu hep true tac dong han lai bS^g each gid edng-tac ta“ng gia^ vo^g quay 
bo tiet che a vao vi tri TANG (XNCR). Bay cim doi sai chung l6n vi tri'cao nhat. ] 

/ f 

k# > Gan lai cay bu-lon noi bo taWong vao can dieu khien bo tiet che^ dieu 
chinh^dau truc^quay bo tac dpng de collide khoang ca'ch 0.010 phan Anh giua tay 
ham bo tiet che va oc ham trer: , va do khoang each nay bang thuoc “do khe hd ? . ' 
(Coi^chi tiet C) Neu can, cat lai vi ^i c^n dieG'khieS sang mot nad rang cua 
<5 tren true quay bo tifit flhS'frhoan tkt viec dieu chiih nay, ma van gid cho. 
vieo an kh6p oua chi oo 6 hai dau true ddoc an toan. 



GHJ 



CHU 



Xhi xiet chat oc chan^tren true tac dong, hay dat dau true vao gida chia 
cua can dieu^khien de cho o bac dan tu chinh co the V chiu diing dude moi 
hudng quay cua true. 
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m. 

ham 



t w / J ^ 

1. ( Noi 1 'ong han true tac dong bang c&eh giu cong-tac tang giam vong quay bo 

tiet che 6 vao vi tri GIAM (DECR). Xhoa can doi sai chung vao vi tri'thap nhit. 

Dic^, chinh oc ham phia diioi de co khoang trong 0.010 phan Anh doi vdi tay 
bo tiet che , va do khoang each nay bang thuoc do khe hb\ Thao bo kep chi" 
trkn giay kern ham , neu co. Hay ton trong gi6i han toi thieu ve chieu dai (coi 
ghi chu 6 bUoc g. ) 

* 

n. Khi cho chay thii luc dau d" dii6i dat va de can doi sai chung d ' vi tri thap"" 
nhat, hay kiem diem tarn quay td 6000 t6i 6700 RPM (+hay- 50) do cong tac tang 

giam vong quay bo tiet che' chi phoi. Neu can, dieu chinh lai thi chuyen dong 

cua bo tac dong de co duoc tarn quay can thiet, dong thdi kiem diem lai khoang 
each va dieu chinh ca hai oc ham bo tiet che. 



o. 

A 



t / 

. chinh lan chot 



V 



dia cam cua bo boi hoan giam 
toe theo quy luat phi hanh. Dieu chinh cam de co the duy tri tain quay 6600 nil 
RPM (+ hay - 40) khi chuyen til sai thap nhat toi toe luc cao nhat, Neu so vong 
quay moi phut bi giam di, hay van dill cam ngddc chieu kirn dong ho ve phia do 

bo chinh toi da. Neu viec dieu chinh lai do bo chinh toi da van chua^ude su 

giam toc^do , hay' keo dai then dieu khien (12) de^gia tang phan lolnong dia cam 

nhin thay d’ phia dddi hop dung/ Hay can than diing de cho con lan thoi dau ra 

6 cuoi lo khia dia cam moi khi di chuyen han ve phia • ben nay hay phia ben kia . 



GHI CHU 



Hay dieu chinh lai cac oc ham bo tiet che de co du6c khoang each can 
thiet sau moi lan thay doi trong viec rap noi he thong/ 



62 




Translators 1 Coined Terms 



m 



Collective pitch control 

Droop, con vpensator 

Governor 

Stop Arm 

Actuator 

Strok e 

Travel 

Feeler gage 

Jam nut 

Clevis 




' • „ 

Tay Ham 



Bo tac a6ng 
thi chuyen clong 

I 4 ^ 

khoang di chuyen 
thvidc cto khe hio’ 
oc chan 
nang, chia 



Positi ve stop adjus ting screw : oc hdm aieu chinh du6ng - (juCt 
self aligning nearing ; bac dan tu chinh 

retaining no it ; bu-lon ham 

y 

Fire wall seal • vahh che ngan Ida 1 

Shear fit ting : c<3 phan rap khit 

Shear joint : each rap chot 
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/l ■- ' ' I A - r ^ 

5-386 CACH LAP RAP - BO TAC DONG VA CAN -DIEU KHXEN 



. „ ~ a" a “ A . „ - a U a a ' „ ' 

a. Dat can dieu khien (17, hinh 5-77) len true dieu khien bo tiet che (18) 
tbigoc gan sat 90 do doi voi duong vach gida cua tay ham true (19) tdi muc 
duong rang cua cho phep,’ Lap bu-lon ham voi vong chem tvi phia sau vao can 
dieu khien va xuyen qua du6ng soi cua true.' Dung giay kem khoa dau bu Ion 
vao dau can dieu khien. 



Hinh S-~71 

a * 

1. Tay truyen luc sax chung 

A / . ^ ^ 

2. Ong dieu khien 

3. Bo gia lap 

A ' ~ ' 

4. Ong soan 

/ 9 

5. Co phan rap khit 

6. Tay truyen ldc L 

7. ch 6 t a-e <& ■ 

9 A S A 

8. La chem, vong chem 

9 . • Vong dem ham 

10. Vanh che ngan Ida 

11. Gia dd 

i a" a 

12. Then dieu khien 

A ' ^ ' A 

13. Mau gan hop cam 

14. Toan bo hop cam 

15. -Dieu chinh dia cam 

16. Bo tac dong co true chay theo duong thang 

% H ^ m v** * 

17. Can dieu khien 

18. True dieu khien bp tiet che , 

j <v 

19. Tay ham true 

20. Oc ham do quay tren 

21. Oc ham do quay dii6i 
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V\ 
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u 

V', 

\V 

•V 1 ' 



1 

4fS ir- 

*,.u. , . 

J >} 

X'/ .X ’\V ; 

rf*i wV'V I. * vSw‘ ***' 

U> A* ; '-vJ 

7T 



Dieu chinh oc ham tren : 
0.250 cho cac dong c6 loai 
T53-L-9/9A 

0.210 cho cac dong c6 loai 

• T53-L^ll/ilB/iy5o) 



,/r 



J® 



0.010- 



. CLEARANCE _ 
AT EACH ST0 b 2 






V 

i^s Vv-vnc 

i.** Vim VaAvaV> 

... 

^ m Va* 






V 



°«... 



/ Ur 



CKI TIET C 



-CAN DIEU KHl|Nl o 









SL T ^ chot \ Chem <£$ Vhoan^X 
ChT n 5A h ^achJaL.0.0qi den 0«003 

!& 



fr i 




/ ^ 

CHI TIET E - each, dieu chinh 
thi" chuyen dong bo tac dong 







Ndi^rong* thu v hep 
(Dieu chinh d£ v cb 
thi" chuyen dong 

4-a^ * 



Dieu chinh neu can. 

— » Mot vong xoay tao 

tdi da. Quayngdbc ra mot khooing di < 

Xf i 10 vong tii g±& chuyln 0.032 phan Anh 
^ moi qc ham 'b^ca* hai oc, ham 

6 chinh toi da 




CHI TIET D v 
Cach dieu chinh 
hop cam 

\ 



\ 



.25 cho cac dong co 

T53-L-9/-9A/ -11/-11B 
0.38 cho dong cd T53-L-13 




CHI TIET v / ^ 
Vi tri lap 6 mdc sai 
chung cao nhat 



Nhin phia sau 
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Hinh 5-77. BQ-phan dieu khien vonnquay.bo tiet che may 
phat ldc tua-bin (Tcf 2 cua‘2 trang) 
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CHAPTER 7 



POWER TRAIN SYSTEM 
SECTION I SCOPE 



7-1. PURPOSE. 

7-2. This chapter provides all the instructions and 
information necessary for maintenance authorized to 
be performed by organizational maintenance activities 
on the power train system. The power train is a sys- 
tem of shafts and gear boxes through which the engine 
drives main rotor, tail rotor, and accessories such as 
DC generator and hydraulic pump. The system con- 
sists of a main drive shaft, a main transmission which 
includes input and output drives and the main rotor 
mast, and a series of drive shafts with two gear boxes 
through which the tail rotor is driven. (See figure 

7-1.) 

7-3. TROUBLESHOOTING - POWER TRAIN, 



7-4. Chart below is a brief summary of power train 
troubles which may be encountered in organizational 
maintenance. Conditions and possible causes listed 
have been limited to those reasonably probable (though 
not necessarily frequent in normal service) which 
could become known through pilot reports or by in- 
spection methods applicable in organizational mainte- 
nance, and which would be subject to some evaluation 
at, this level, although final corrective action by a 
higher level might be required in some instances. 
Conditions involving obvious major damage are omit- 
ted, as are those caused by accident or an unusual 
chain of events which would require evaluation by a 
competent authority. Notes below provide information 
in addition to that available in trouble shooting chart 
and in maintenance instructions for systems and com- 
ponents of power train. 



INDICATION OF 
TROUBLE 


PROBABLE 

CAUSE 


CORRECTIVE 

ACTION 


TRANSMISSION: 
Low oil pressure 






(1) On caution panel or 
pressure gage, but not both 


Faulty caution panel or gage 
circuit or unit 


Repair electrical circuit 
or replace faulty unit 


(2) Shown by both caution 
panel and gage 


Pressure relief valve 
malfunction 


Adjust or replace valve 




Clogged pump screen 


Clean screen, check oil for 
chips or contamination 




Faulty oil pump 


Replace pump 




Leakage or restriction between 
pressure relief valve and trans- 
mitter 


Repair oil line connections 
or replace seals 


No oil pressure 






(1) With normal oil level 


Faulty gage or transmitter or 
circuit 


Repair circuit or replace 
faulty unit 




Oil pump failure 


Replace transmission or if 
transmission is not internally 
damaged, replace pump only 


(2) No oil supply 


Leak in system or failure to 
service 


Replace transmission. Also 
replace cooler, flush and 
repair external lines 


Grease leakage at tail 
rotor drive coupling 


Damaged seal 


Replace seal in quill 
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INDICATION OF 
TROUBLE 



High oil pressure 



High oil temperature 



(1) On caution panel or 
temperature gage, but not 
both 

(2) Shown on both caution 
panel and gage 



PROBABLE 



Faulty gage or transmitter or 
circuit 

Pressure relief valve 
malfunction 



Pressure relief valve 
malfunction 

Faulty caution panel or gage 
circuit or unit 



Obstructed air flow around 
transmission 



CORRECTIVE 

ACTION 



Repair circuit or replace 
faulty unu 

Adjust or replace 



Adjust or replace valve 



Repair circuit or replace 
faulty unit' 



Clear cowl opening and 
sump area 



These questions were answered by the Vietnamese airmen after read- 
ing one of three translations of the preceding section of the UH-1H 
TM. 



Please read the Vietnamese passage about the helicopter. 
After you read the passage, answer the ten questions. Write down 
the exact words in the Vietnamese essay that allows you to answer 
each of the ten questions. 

1. The passage provides instructions for the maintenance of 
helicopters. Who is authorized to perform the maintenance? 

2. Name the parts that the main transmission includes? 

3. There are two methods that allow conditions and possible 
causes to become known. Name one of the methods. 

4. There are two kinds of conditions that are omitted. Name 
one of the conditions . 

5. There are two ways that low oil pressure is indicated. Name 
one of the two ways. 

6. Is a faulty oil pump an 

(a) indication of trouble 

(b) a probable cause, or 

(c) a corrective action? 

7 . If there is a grease leakage at tail rotor drive coupling, 
what is the corrective action? 
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8. If the corrective action is to replace the transmission and 
also replace cooler, flush and repair external lines, what 
is the probable cause that led to that action? 

9. When high oil pressure is an indication of trouble, there 

are two probable causes. Name one of the two probable 
causes. 

10. If the probable cause of a trouble is an obstructed air 
flow around transmission, what is the corrective action? 
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